Midrash sur Rois 2 2:24

And Abraham, son of Terah, passed by, and saw them building the city and the tower, and he cursed them in the name of his God, as it is said, "Swallow up, O Lord, divide their language" (Ps. 55:10). But they rejected his words, like a stone cast upon the ground. Is it not a fact that every choice and good stone is only put at the corner of a building? and with reference to this, the text says, "The stone which the builders rejected is become the head of the corner" (Ps. 118:22).